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We perform an accurate test of Ultrametricity in the aging dynamics of the three dimensional 
Edwards-Anderson spin glass. Our method consists in considering the evolution in parallel of two 
identical systems constrained to have fixed overlap. This turns out to be a particularly efficient 
way to study the geometrical relations between configurations at distant large times. Our findings 
strongly hint towards dynamical ultrametricity in spin glasses, while this is absent in simpler aging 
systems with domain growth dynamics. A recently developed theory of linear response in glassy 
systems allows to infer that dynamical ultrametricity implies the same property at the level of 
equilibrium states. 
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The dispute about the nature of the spin glass phase of 
finite dimensional spin glasses has lasted by now almost 
twenty years, after that the droplet model has chal- 
lenged the predictions of mean field theory (MFT) [|. 

In the last years a large collection of numerical data 
have tested, with positive answer, the applicability of 
spin glass mean field picture to finite dimensional (d=3,4) 
systems ||-||. However some of these numerical evi- 
dences have been recently re-interpreted as finite volume 
effects by the authors of Ref. [|| and so many questions 
on the low-temperature phase of finite dimensional spin 
glasses still remain unaswered. 

One of the most characteristic aspects of mean field 
theory is the prediction of ultrametricity (UM) 0. At 
low temperature the ergodicity is broken and many low 
free energy states are present. Ultrametricity implies 
that the distances between these states verify an inequal- 
ity stronger than the triangular one (see below) . However 
this property has been rather elusive to a direct probe. 
The best evidences in favor of this property have been 
given (to our knowledge) in Refs. @||. In the former 
it was studied the equilibrium of a 4c? spin glass model 
using small samples. In the latter very-low-energy con- 
figurations of a 3d model were used, again for relatively 
small samples. In both cases an extrapolation to large 
volumes was needed in order to check ultrametricity. In 
this paper we present results for the 3d spin glass model 
with a method that allows us to reach much larger sizes. 

Another fundamental aspect of MFT is the prediction 
of slow dynamics and aging This is a non sta- 

tionary asymptotic regime, following a quench from a 
high temperature, which persists forever in infinite sys- 
tems. In this out-of-equilibrium regime, the equilibrium 
property of ultrametricity has a dynamical counterpart in 
ultrametric relations among time dependent autocorrela- 
tion functions. Recent results of linear response theory 
succeeded to relate in a unique way properties of stat- 
ics and dynamics, relying on the recently introduced hy- 
pothesis of stochastic stability |l3j . This property states 
the continuity of the average correlation functions un- 



der weak random perturbation of the Hamiltonian. The 
validity of the property in three and four dimensional 
spin glasses has been numerically verified in Ref. [Q. A 
remarkable consequence of stochastic stability is that dy- 
namical ultrametricity implies the static one Jl4| . 

In this paper we investigate the possibility for dynami- 
cal UM in the three dimensional Edwards- Anderson (EA) 
model. For comparison we also perform the same test on 
models with domain coarsening off-equilibrium dynam- 
ics, where UM should not be expected. 

The high evidence we can achieve is based on a new 
dynamical method where we evolve in parallel two iden- 
tical systems (replicas for short) with fixed value of the 
mutual overlap. This is analogous to a conserved-order- 
parameter dynamics in a ferromagnetic system and it is 
similar to the one already used in Ref. [pi to study the 
equilibrium behavior. 

The EA model is defined by the Hamiltonian H(S) = 
J2<ij> JijSiSj where the spins are Ising variables, the 
sum spans the nearest neighbors pairs on a cubic lat- 
tice, and the couplings Jy are normally distributed 
quenched independent random variables. We define the 
overlap among two spin configurations S 1 and S 2 as 
<7i2 = L~ 3 J2i SjSf, which is directly related to the Ham- 
ming distance d\2 through qi2 = 1 — di2- 

The mean field equilibrium solution of this model has 
the ultrametric property at low temperature; for each 
three configuration S 1 , S 2 and S 3 chosen with Boltzmann 
probability, the following inequalities hold: 

q u > min{gi 3 ,g 2 3} , di2 < max{o?i 3 , d 2 s} , (1) 

which are much stronger than the usual triangular one 
du < G?i3 + c?23- Moreover in Ref. has been shown 
that, if some kind of ultrametricity holds in the low- 
temperature phase of the EA model, it must be of the 
same kind of that present in the mean-field solution. 

In the off-equilibrium dynamical solution a rela- 
tion analogous to Eq. (jl|) holds for the two-time auto- 
correlation functions: C{t,t') = L~ 3 £\ Si(t)Si(t'). 
Taken three large times t\ <C t% <C £3, one finds that 
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C(t 1 ,i 3 )=min{C(t 1) t 2 ) 1 C(t2 ) t3)} (2) 

The precise statement is that the relation among the cor- 
relations should tend to the one of Eq. (|J) in the infinite 
time limit Jll|,|f2| . In the simulations the relation among 
the three correlations is plagued by strong finite time ef- 
fect, so that a direct verification would be difficult with 
the present computer resources. We therefore decided to 
probe a relation which for long times is consequence of, 
and equivalent to, Eq.(||). We consider the dynamics of 
two replicas of the system with the same disorder, S 1 and 
S 2 , which evolve in parallel with different thermal noises 
and constrained at each time to have a fixed mutual over- 
lap qo- The dynamics follows a quench at time zero and 
we measured the auto- and cross-correlation functions 

i i 
i i 

Note that C(t,t) = 1 for Ising variables, while the con- 
straint implies D(t,t) = qo- 

We would like to argue, with a hand waving argument, 
that the relation in Eq.(|J) entails the following ultra- 
metric constraint on the cross-correlation function if the 
value of qo is between and the value of the Edwards- 
Anderson parameter g BA : 

D(t,t')=min{C(t,t'),q } (4) 

During the relaxation the free energy of the system de- 
creases monotonically towards its equilibrium value. This 
will be higher or equal to the one of the unconstrained 
system at the same temperature. The basic observation 
is that, if qo is one of the values allowed for the overlap 
among equilibrium states, i.e. qo G [0, <?ea], the equilib- 
rium free-energy of the constrained system should coin- 
cide with the one of the unconstrained one Jl(|. Eq.(j|) 
expresses the fact that for large times, the directions 
in which the system can go without increasing the free- 
energy must be compatible with ultrametricity. The con- 
strained system can lower its free-energy down to the 
equilibrium value only if all the possible correlations one 
can form (auto and cross) verify for long times UM in- 
equalities. As two of the 4 correlations that can be 
formed with the configurations S 1 (t), S 1 (t'), S 2 (t) and 
S 2 (t') are fixed to qo, Eq.(^) should follow. A formal 
argument leading to the same conclusions can be formu- 
lated [jl7|, extending to constrained systems the corre- 
spondence among statics and dynamics mentioned above. 

In order to see how restrictive relation in Eq.(|J) is, let 
us discuss what one can expect on a general ground for 
the relation among D and C in a relaxational system. 
In Fig. |l| we display the set of allowed values for C(t, t') 
and D(t,t') (shaded area), simply assuming the triangu- 
lar relation and a monotonic decrease of both functions 
when the time argument's difference increases. The set 



of values allowed by the UM relation is represented with 
the bold dashed line. 
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FIG. 1. Schematic draw of the region of allowed values for 
C and D (shaded area). The ultrametric relation force them 
on the bold dashed line. 



In order to check whether Eq. (|4j) holds in the 3d 
EA model, we have simulated, by Monte Carlo method 
(Metropolis update), two coupled systems with a soft 
constraint J^. SiS^ ~ L 3 q , imposed modifying the Boltz- 
mann weight with a Gaussian of width proportional to 
L~ 3 / 2 , such that the weight of a configuration would be 
exp[-0(H(8i) + H(S 2 )) - XL 3 (q 12 - q ) 2 /2}. The value 
of the A parameter must be appropriately tuned: a too 
small value would not force enough the systems and their 
overlap will be systematically different from the one we 
fixed (qo)- On the other hand a too large value would ren- 
der movements too unprobable and the dynamics would 
evolve very slowly. In the whole set of runs we fixed 
A = 5 for the EA model and A = 2 for the other models. 
The choice has been made with the aim of maximizing 
the Monte Carlo acceptance rate, avoiding the systematic 
errors just described. We have checked (see Fig. ||) that, 
for these values of A, qu(t) tends to the desired value qo- 

As we study the behavior of the model in the aging 
regime, we do not need to reach thermalization and we 
can simulate large sizes (L = 24). For such volume, fi- 
nite size effects do not affect the dynamical regime we 
study. The critical temperature of a single uncoupled 
model is T c = 0.95(4) [| and we simulate the system in 
the spin glass phase at T = 0.7. The large size, the low 
temperature and the starting configuration, which is ran- 
domly chosen, ensure that the system stays in the aging 
regime all along the simulation which can be as long as 
10 s MCS. These high performances have been achieved 
using the parallel computer APEI00 Jl8[ j . 

All the correlation functions we measure are extensive 
and self-averaging quantities, so we do not need a large 
number of disorder realizations. Their fluctuations are 
small thanks to the large volume used and we average the 
results on a quite small number of samples (Ns = 10). 
The error on the data is always calculated as the samplc- 
to-sample fluctuation. 
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FIG. 2. The time evolution of the overlap between the pairs 
of EA systems at temperature T — 0.7 with go = 0.6. In the 
inset we show the energy difference between a constrained 
and a free system at the same temperature. The upper data 
correspond to T = 0.7 and qo = 0.6 < q EA and are clearly 
compatible with zero. The lower data correspond to T = 0.9 
and go = 0.9 > g E A and show how the energy of the con- 
strained system is lower. 

The first quantities we have studied are the overlap of 
the two replicas and the internal energy as a function of 
time. As announced, we see in Fig. |^ that the overlap 
converges towards the value go we have fixed. The "soft" 
way of imposing the constraint is evident in the behavior 
of the overlap, which is not equal to go during all the 
run, but clearly converges to it. In the forecoming anal- 
ysis we will use only the data obtained in the time range 
where the overlap is statistically compatible with go, that 
is t w > 10 5 . The data in the inset of Fig. || show the dif- 
ference between the energy of the constrained system and 
that of a free system evolving at the same temperature 
after a quench at time zero. As we expected, the en- 
ergy difference tends to zero, as it should if the value go 
is allowed at equilibrium, while for go > g EA the energy 
difference goes to a finite value. 

In Fig. |3j we show our main result: plotting the cross- 
correlation as a function of the auto-correlation we ob- 
tain, for relatively long times, that the data points are 
quite close to the UM bound. A perfectly ultrametric 
system would stay on the line D = go = 0.6 as long as 
C > go and then would follow the line D = C (both 
lines are plotted in Fig. ||). The data for the 3d EA 
model are clearly converging to the UM bound: we re- 
mind the reader that the data cannot leave the shaded 
area of Fig. [j], that is they cannot cross any of the bound- 
ary lines reported in Fig. ^, and so we expect that they 
naturally converge to the UM bound. 

To understand better how probing are our data, we 
have also simulated two models where UM is not ex- 
pected to hold: the 2d ferromagnetic Ising model, and 
its site diluted version in 3d. The off-equilibrium dy- 
namics of both models shows a domain coarsening regime 
where the correlation function depends on both times as 
C(t,t') « C(t'/t), a scaling form incompatible with ul- 
trametricity. 
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FIG. 3. Plot of the cross-correlation function versus the au- 
tocorrelation one in the 3d EA model at temperature T = 0.7 
for two waiting times t w = 10 6 , 10 7 . The curves approach the 
UM bound as t w grows. The solid lines are the boundaries 
of the shaded area of Fig. ^. In the inset we display the time 
dependence of the two functions. 



We have simulated a 2d pure ferromagnetic Ising model 
of linear size L — 2000 at a temperature T = 1.5 
(Tg ~ 2.27). We choose a very large size and small 
waiting times (t w — 32, 64, 128) in order to avoid that 
the system gets out from the aging regime we are inter- 
ested in. These times are sufficiently large to be close to 
the scaling regime. The data are averaged on N$ = 100 
different noise realizations. 
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FIG. 4. The same plot as Fig. H for (A) the pure ferro- 
magnet in 2d at T — 1.5 and (B) the 3d diluted ferromagnct 
at T = 1.67. The waiting time effect is opposite to the one 
observed in the spin glass. 



The data from the pure ferromagnetic system are plot- 
ted in Fig. ^A in the usual D(t, t w ) versus C(t, t w ) plot. 
We also report the bounds of the allowed region (the 
shaded region of Fig. |l|). Note that the data are far away 
from the UM bound and they seem to converge to some 
t-ui-independent curve. 

Maybe one can think that the comparison of a spin 
glass with the pure ferromagnet is not enough. So we 
have simulated also a 3d site-diluted ferromagnetic Ising 
model, which has a coarsening dynamics similar to that 
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of the pure model, but much slower Jl9| ] and complicated 
by interface pinning. We have simulated two samples 
(each one consisting of a pair of interacting systems) of 
linear size L = 200 and spin concentration c = 0.65. The 
temperature is well deep in the frozen phase, T = 1.67, 
the critical temperature being T c 3rf (c = 0.65) ~ 2.70 [po[. 

In Fig. ||b we see that the behavior of the data from 
the diluted ferromagnetic model may resemble that of 
the EA model, because it seems to be somehow close to 
the UM bound. 



M. A. Virasoro and R. Zecchina for useful discussions. 
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FIG. 5. Zooms of Figs. H andkUB in the region of D close to 
the upper boundary D = go- The comparison of the two plots 
makes clear that the effect of the waiting time is opposite in 
the two cases, and the long time extrapolation is certainly 
very different. 

Looking carefully at the figure we note, however, that 
the ^-dependence of the data in Fig. || and in Fig. ||B are 
opposite. In fact increasing the waiting time, the value of 
the auto-correlation function at the point where the data 
leave the horizontal line decreases in the spin glass case, 
while it increases in the diluted ferromagnetic case. To 
make this effect clearer we zoomed the region of Fig. |§| 
and |^B near the horizontal line (see Fig. ||) . 

Summarizing, we have used a new numerical method 
to test ultrametricity in short range spin glasses. We 
find evidence that for long times the ultrametric equality 
between two time correlations become fulfilled. As we al- 
ready stressed the property of stochastic stability implies 
then static ultrametricity. The behavior of spin glasses is 
strikingly different from the behavior of ordered and dis- 
ordered models with domain coarsening, where we find 
incompatibility with ultrametricity. 
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